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RESEARCH SUMMARY 

iis report is designed to provide the information required to evaluate 
Decific Aptitude Test Battery (SATB) for Line Repairer from two points 
Jew: (1) technical adequacy of the research; and (2) usefulness of 
ittery to Employment Service staff, apprentice selection committees, 
nployers in selecting individuals for training as Line Repairers. 

^search demonstrated a statistically significant and useful relation; 
stween proficiency as Line Repairer Apprentice and the following Spec 
Dtitude Test Battery: 

Aptitudes Cutting Scores 

V - Verbal Aptitude 90 

N - Numerical Aptitude 85 

S - Spatial Aptitude 105 

K - Motor Coordination 80 

le validation sample for this SATB consisted of 213 Line Repairer apprent 
elected through the National Joint Apprenticeship and Training Commi 
^ogram (including 7 blacks, 8 Hispanics, 1 American Indian, and 8 Fn 
madians). Data were collected during 1973 to 1981. The tests used \ 
lose of the General Aptitude Test Battery (GATB) Form B-1002B. Since it 
jcessary for an apprentice to successfully complete both job related coui 
id on-the-job training, a multiple-hurdle criterion consisting of supervi; 
itings and training course grades was used. 

: was not technically feasible to compare the validity of the battery 
nority and nonminority groups, as it was not possible to obtain data c 
ifficient number of workers in any specific minority group to permit sepai 
ita analysis. Descriptive statistics for validation samples are shown 
ipendix 2. 

ie SATB can be expected to produce a useful increase in the proportion 

" - - - 



current job description for Line Repairer was provided to all participa 
tates. JATC officials and supervisors were consulted to ascertain that 
pprentices were doing the same job and were given the same course work, 
ob description shown in Appendix 5 is the result of this action and ma^ 
sed to provide information on the applicability of the test battery resul 
rom this research. 

ach job duty was rated for frequency of performance, percentage of time sp 
nd level of difficulty as part of the job analysis. Critical job duties 
dentified on the basis of these ratings. 

t each location at least one analyst rated each aptitude as irrelev 
nportant or critical to performance of the job duties. A synthesis of t 
atings and their rationale follows: 



Spatial Aptitude 



Required to visualize three-dimensi 
installations from blueprints, specificati 
and instructions, to lay out and ins 
underground ducts, to erect steel po 
columns, raise gin poles, and to string wi 



Form Perception 



Motor Coordination 



Finger Dexterity 



Manual Dexterity 



Required to perceive 
similarities in size and 
and operational processes 
ness of construction. 



differences 
shape of equip 
to assure corr 



Required to coordinate eye-hand movement! 
manipulating hand tools and accurately pla 
parts. 

Required to manipulate tools, to splice ca 
and to handle implements to perform du 
prescribed. 

Required to pull levers, place objects, 
wheels and maneuver implements of the trad 



<perimenta1 Test Battery 



)up members. All of the 213 subjects were male. The means and stand 
nations for age and education on sample members are shown in Table 1. 

subjects, except dropouts, had been in the Line Repairer Apprentices 
>gram for at least one year. The Joint Apprenticeship and Training Commit 
U"C) referred the selected candidates for the apprenticeship program to 
:al offices for testing at the time they were admitted into 
>renticeship program. This longitudinal study was initiated in 1973. 
; of the apprenticeship applicant was 18 to 24 years of age and 
icational requirement was high school graduation or the GED high sch 
i i valency test. 

teria for Validation Study 

j criteria for the validation study consisted of combined supervisory rati 
I test scores on 6 units of class work. The instructors sent the test sco 
the test research analysts after completing each unit. The supervis 
:ings were collected on the apprentice approximately one year after they w 
lentured into the apprenticeship program. 

>ervisory ratings were obtained by means of personal visits of test resea 
ilysts to JATC coordinators and employers. The rating procedure 
ilained to the JATC coordinators and to first and second line supervisors 
; apprentices. Each subject was rated twice by a first line supervisor w 
interval of two weeks between ratings, or once each by a first line an 
:ond line supervisor. Since sample members' aptitude test scores 
ifidential, supervisors had no knowledge of apprentices' aptitude t 
>res. Thus, the possibility of these scores affecting ratings did not exi 

iescriptive rating scale was used. The scale (See Appendix 3) consists 
: items. Five of these items cover different aspects of job performance, 
:th is a global item on the Line Repairer's "all-around" ability. Each i 
; five alternative responses corresponding to different degrees of 
>ficiency. For the purpose of scoring items, weights of 1 to 5 were assig 
the responses. The total score on the rating scale is the sum of 
ghts for the six items. The possible range for each rating is 6-30 or 12 
combined ratings. 

-eview of the job description indicated that the items covered by the rat 

lie were dirprt.lv rplatpH tn imnnrtant a<;nprt<; nf inh rlut.ipq nprfnrmprl 



meet JOD specifications, local DUI icnng cooes anu bareuy requirem 
as determined by the Occupational Safety Act of 1970. 

Accuracy of work: A Line Repairer must be able to accura 
interpret working drawings and correctly install all wiring sys 
according to government requirements, local codes and 
specifications. 

Job knowledge: A Line Repairer must have knowledge of materials 
to install or repair systems for power generating facilities. 

Job versatility: A Line Repairer must be capable of performir 
wide variety of installation and repair tasks with many types 
materials under various conditions and locations. 

"All-around" job ability: A Line Repairer's value to the empl 
involves a combination of the aspects of job performance li 
above. 

reliability coefficient of .80 was obtained between the two different 
srformance ratings, indicating a significant relationship. Therefore, 
inal job performance criterion consisted of the combined scores of the 
atings. The possible range for the combined scores was 12-60. The ac 
inge for the total was 15-60. The mean was 43.3 with a standard deviatio 
, 1. Table 1 shows the relationship between the job performance criterion 

e and education. 



scores were obtained from JATCs and units of class work required for f 
?ar apprentices (144 hours). Each apprentice was tested after completing 
lit (6 units covering four subjects and a final test). Training co 
ascriptions for first year Line Repairer Apprentice (See Appendix 4) 
tandard throughout the nation, having been coordinated through the Nati 
\TC. The actual range for the total sample was 430-600. The mean was 
ith a standard deviation of 30.0. The relationship between the rel 
mining criterion and age and education is shown in Table 1. 

ie correlation between the combined supervisor rating and the sum of the 
lit scores was .15. Each of the two criterion is used to measure a diffe 
spect of job performance. The fact that differential measurement 
idicated and each criterion correlated significantly with most GATB aptit 



for Age and Education 2 

Validation Sample 

N = 213 
Mean SD r r 

L_ c. 

Age (years) 22.38 2.96 0.12 0.15* 

Education (years) 12.56 1.01 0.08 0.18** 

*Significant at the .05 level. 
**Significant at the .01 level. 



ANALYSIS 

le initial step in analysis is to identify those aptitudes which show 
n'dence of validity and job relatedness. This evidence can be: 

, Statistical evidence of the correlation (r) between the test and the 
criterion. 

, Content validity as evidenced by a rating of "critical" based on the jo 
analysis or, 

Any combination of the following: 

-- high mean 

-- low standard deviation (SD) 

-- rating of "important" based on job analysis 

-- demonstrated validity in a prior validation study. 

:atistical results for the validation sample are shown in Table 2. 

TABLE 2 

Statistical Results for Validation Sample 

N = 213 

Aptitude Mean SD rl i 

- General Learning Ability 108.3 1"574 .IF* .1 

AMIitv 1 f\0 19 A 1 * 



Summary of Qualitative and Quantitative Data 
for Validation Sample 



Type of Evidence 


Aptitudes 


G V N S P 


Q 


K F M 


Job Analysis Ratings 
Critical 
Important 
Irrelevant 


X X 




XXX 


Statistical Evidence 
High Mean 
Low SD 
Significant r 
Instructor Rating 
Supervisor Rating 


X 
X 

X X X X 
XX XX 


X 
X 

X 
X 


X 
X 

X 
X X 


Aptitudes Considered 
for Inclusion in the 
Battery 


G V N S P 


Q 


K F M 



e information in Table 3 indicates that all aptitudes measured by the G^ 
ould be considered for inclusion in the battery. The objective was 
velop a battery of 2, 3, or 4 aptitudes with cutting scores at the point 
ere about the same percent would meet the cutting scores as the perci 
aced in the high criterion group and (b) which would maximize 
lationship between the battery and the criterion. 

e cutting scores were set at approximately one standard deviation below 
an aptitude scores of the sample, with deviations at five point intervi 
ove or below these points to achieve the objectives indicated above. 



e following battery resulted: 

Aptitudes 



Cuttina Scores 



This section of the report first presents evidence of criter 
validity of the SATB on the validation sample. Next, it provides 
on the effectiveness of test norms. 



It was not technically feasible to compare the validity of the 
minority and nonminority groups because it was not possible to obtai 
sufficient number of workers in any specific minority group to perrr 
data analysis. 



Criterion Related Validity 



Table 4 shows that there is a significant relationship 
performance criterion and the SATB for the validation sample 



p betwe* 
in aggr 



TABLE 4 
Validity of the Battery 



Sample 


N 


High Criterion Low Criterion 
Group Group 


Chi 
Square 


Signi 
can 
lev 
P/2 


Below 
Cutting 
Score 


Meeting 
Cutting 
Score 


Below 
Cutting 
Score 


Meeting 
Cutting 
Score 


Validation 
Total 


213 


37 


107 


45 


24 


30.77 


.00 



and 
,005 



Multiple regression analysis was conducted between V, N, S, 
criterion. A multiple correlation of .39 (significant at the 
obtained between the job performance criterion and aptitudes V, N, S 

Effectiveness of the Battery 

The level of validity shown in Table 4 indicates that the batte 
useful in selection. In the total validation sample 68% were consi 
highly proficient. Of those who met the cutting scores, 82% were j 
hiahlv oroficient. an increase of 14 nercentaoe ooints over tf 







uriuciiim <^ i i ^c i i u 

Group) Group) 


Selection 


Number 




% of 




% 


System 


Selected 


N 


Total 


N 


To 


Validation Sample 












Without Tests 


213 


144 


68 


69 


3 


With Tests 


131 


107 


82 


24 


1 



e research sample consisted of workers employed for one year as Line Repai 
prentice; presumably those workers who lacked the required abilities had q 
dropped out of the apprenticeship program. Therefore, a greater incre 
er existing selection methods in the proportion of highly proficient work 
lected is to be expected when the battery is used for selection purposes, 
e ra-nge of relevant abilities is almost certainly greater among applica 
an among employed workers. 



Repairer S-154R on t 
in July 1958, is S- 
for the total validat 



ior Battery 

alysts tested previously validated norms for Line 
lidation sample. The original battery, validated 
70. This battery produced a phi coefficient of .03 
mple. 

oss Validation Sample 

e original sample, N=59, was gathered in one metropolitan area, at a t 

en no records were kept on minority composition. Analysis of the origi 

mple with V-90, N-85, S-105, K-80 produced a phi coefficient of .14, which 
t statistically significant. 

forts to Obtain Ethnic Representation 

int Apprenticeship Training Committee's made nationwide attempts to obt 
mples with sufficient minority representation to analyze the data 
irness to minorities. Results of these attempts are shown in Appendix I. 



nonminority validities differ for the abilities measured on the 
cumulative study combining all available SATB validation samples \ 
U.S. Employment Service Data Bank concluded that "differential 
probably does not exist in sufficient magnitude to moderate validl 
appreciable or practical degree." (J. Hawk, 1983) This finding 
those of other researchers. For instance, Hunter, Schmidt and Hun 
examined 866 validity coefficients in a comprehensive review concl 
there was no evidence to establish true differential validity. These 
based on massive amounts of data, support Humpreys 1 (1973) concli 
there is little likelihood that minorities are not part of the same 
as the majority, and a test that is valid for the majority is also 
minorities. 

This cumulative evidence has also led to similar conclusions by th 
Research Board, "we find little convincing evidence that well const 
competently administered tests are more valid for one population sub 
for another: individuals with higher scores tend to perform better 
regardless of group identity." The APA Division 14 Principles (198 
the following: "Because many characteristics studied appear to have 
no effect on predictor-criteria relationships, no variable should be 
moderate validities in the absence of explicit evidence for such 
For example, the research literature shows that validities within ra 
vs. white) are usually comparable on cognitive selection tests." 
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COMMITTEE'S REPORTS OF APPLICANTS 

IN LINE REPAIRER STUDY BY 

CENSUS REGION 

1973-1981 



Total applicants who applied 

for Line Repairer Study 

1973-1981 



Number of applicants indentured 
in Line Repairer Study 
1973-1981 



Number of applicants who left 
Line Repairer Study 
During the First 
Year 1973-1981 



NORTH 


SOUTH 


WEST 


NON- 
MIN. 


MIN. 


NON- 
MIN. 


MIN. 


NON- 
MIN. 


MIN 


11,135 


1,815 


2,368 


178 


1,028 


69 


1,518 


114 


765 


66 


249 


12 


426 


53 


137 


22 


50 


5 



Note: The minority columns include only Black and Hispanic applicar 



Variable Mean S^ Range r. 

-^ 

Aptitude G 108.3 15.4 69-168 .16* 

Aptitude V 102.6 12.4 65-156 .16* 

Aptitude N 105.4 16.3 59-154 .09 

Aptitude S 113.3 17.4 71-153 .18** 

Aptitude P 117.3 17.4 68-165 .22* 

Aptitude Q 115.2 13.7 71-172 .17* 

Aptitude K 105.0 14.5 70-146 .07 

Aptitude F 105.3 18.6 46-171 .13* 

Aptitude M 115.0 19.8 66-186 .15* 

Age (years) 22.38 2.96 18- 32 .12 

Education (years) 12.56 1.01 9- 16 .08 

*Significant at the .05 level 

**Significant at the .01 level 



DESCRIPTIVE RATING SCALE 

SCORE 

RATING SCALE FOR 



D.O.T. Title and Code 



Directions: Please read the "Suggestions to Raters" and then fill in the items which follow. In making your 
ratings, only one box should be checked for each question. 

SUGGESTIONS TO RATERS 

We are asking you to rate the job performance of the people who work for you. These ratings will serve as 
a "yardstick" against which we can compare the test scores in this study. The ratings must give a true picture 
of each worker or this study will have very little value. You should try to give the most accurate ratings 
possible for each worker. 

These ratings are strictly confidential and won't affect your workers in any way. Neither the ratings nor 
test scores of any workers will be shown to anybody in your company. We are interested only in testing 
the tests." Ratings are needed only for those workers who are in the test study. 

Workers who have not completed their training period, or who have not been on the job or under your 
supervision long enough for you to know how well they can perform this work should not be rated. 
Please inform the test technician about this if you are asked to rate any such workers. 

Complete the last question only if the worker is no longer on the job. 

In making ratings, don't let general impressions or some outstanding trait affect your judgment. Try to 
forget your personal feelings about the worker. Rate only on the work performed. Here are some more 
points which might help you: 

1 . Please read all directions and the rating scale thoroughly before rating. 

2. For each question compare your workers with "workers-in-general" in this job. That is, compare your 
workers with other workers on this job that you have known. This is very important in small plants 
where there are only a few workers. We want the ratings to be based on the same standard in all the plants. 

3. A suggested method is to rate all workers on one question at a time. The questions ask about different 
abilities of the workers. A worker may be good in one ability and poor in another: for example, a very 
slow worker may be accurate. So rate all workers on the first question, then rate all workers on the second 
question, and so on. 

4. Practice and experience usually improve a worker's skill. However, one worker with six months' experience 
may be a better worker than another with six years' experience. Don't rate one worker as poorer than 
another merely because of a lesser amount of experience. 

5. Rate the workers according to the work they have done over a period of several weeks or months. Don't 

ratA iiiot r\n tViA Kocic *-*f r\nt* 4 *rt/-vrw^ " riot/ r\r nna "VviH ** /lot/ rvr cntvtA cinrrl^ t>s*i*4ari t T*Kinlr iri +AOTYIC f\f 



Company Job Title: 



How often do you see this worker 
in a work situation? 

D All the time. 
CD Several times a day. 
CH Several times a week. 
D Seldom. 



How long have you worked with 

CD Under one month. 
CD One to two months. 
CD Three to five months. 
CD Six months or more. 



A. How much can this worker get done? (Worker's ability to make efficient use of time and to work at hi 
(If it is possible to rate only the quantity of work which a person can do on this job as adequate or in 
use #2 to indicate "inadequate" and #4 to indicate "adequate.") 

CD 1. Capable of very low work output. Can perform only at an unsatisfactory pace. 

CD 1. Capable of low work output. Can perform at a slow pace. 

CD 3. Capable of fair work output. Can perform at an acceptable pace. 

CD 4. Capable of high work output. Can perform at a fast pace. 

C3 5. Capable of very high work output. Can perform at an unusually fast pace. 

B. How good is the quality of work? (Worker's ability to do high-grade work which meets quality standa: 

CD 1 . Performance is inferior and almost never meets minimum quality standards. 

CD 2. Performance is usually acceptable but somewhat inferior in quality. 

CD 3. Performance is acceptable but usually not superior in quality. 

CD 4. Performance is usually superior in quality. 

CD 5. Performance is almost always of the highest quality. 

C. How accurate is the work? (Worker's ability to avoid making mistakes.) 

CD 1. Makes very many mistakes. Work needs constant checking. 

CD 2. Makes frequent mistakes. Work needs more checking than is desirable. 

CD 3. Makes mistakes occasionally. Work needs only normal checking. 



D 4. Has broad knowledge. Knows enough to do good work. 
3 5. Has complete knowledge. Knows the job thoroughly. 

',. How large a variety of job duties can the worker perform efficiently? (Worker's ability to handle several different 
operations.) 

H 1. Cannot perform different operations adequately. 

U 2. Can perform a limited number of different operations efficiently. 

D 3. Can perform several different operations with reasonable efficiency. 

U 4. Can perform many different operations efficiently. 

D 5. Can perform an unusually large variety of different operations efficiently. 

Considering all the factors already rated, and only these factors, how good is this worker? (Worker's all-around 
ability to do the job.) 

H 1. Performance usually not acceptable. 

D 2. Performance somewhat inferior. 

D 3. A fairly proficient worker. 

D 4. Performance usually superior. 

II 5. An unusually competent worker. 

Complete the following ONLY if the worker is no longer on the job. 

t. What do you think is the reason this person left the job? (It is not necessary to show the official reason if you 
feel that there is another reason, as this form will not be shown to anybody in the company.) 

H 1. Fired because of inability to do the job. 

3 2. Quit, and I feel that it was because of difficulty doing the job. 

3 3. Fired or laid off for reasons other than ability to do the job (i.e., absenteeism, reduction in force). 

II 4. Quit, and I feel the reason for quitting was not related to ability to do the job. 

H 5. Quit or was promoted or reassigned because the worker had learned the job well and wanted to advance. 
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irst year apprentices receive instructions as described below in order 
iccessfully complete apprenticeship training and become a journeyman I 
jpairer. Training course descriptions for first year Line Repairer Appreni 
jre standard throughout the nation, coordinated through the National J/ 
iere are 6 units of class work (144 hours) covering basic tools and 
iformation, safety, mathematics and theory. 

ISIC JOB ^INFORMATION Training units of class work are given on the be 
>ols and job information needed to successfully complete the training: Toe 
)les; unloading poles; framing and hauling poles; digging holes; setl 
iles; climbing poles; rope; blocks and slings; guy types; guy install at" 
ty strength and sizes; anchors; line conductors; crossarms and attachmer 
>unting crossarms; pins and insulators; climbing equipment inspection 
ire; wire sizes; stringing wires; tying in; hand signals; good housekeepi 
% ee trimming; overhead service. 

iFETY Safety instructions in: developing safe working attitudes 
icognizing unsafe working conditions; first aid, bleeding and its cont* 
ifety procedures and proper use of hats; cutouts; and ladders. 

JHEMATICS A review of basic math processes: addition and subtract! 
i Iti plication and division; fractions; decimals; simple equations; mathemat 
>r parallel circuits; percentage; ratio and proportions. 

IEORY Instructions on the electric system: electricity and matt 
ectrical units; Ohm's Law; series circuits; parallel resistances; paral 
rcuits; combination circuits; mechanical work and force; electrical pov 
tteries; fuse principles; principles of magnetism; electricity and magneti 
ignetic circuits; transformers; wire resistance; voltage drop; principles 
Deration. 



APPENDIX 5 
JOB DESCRIPTION 



lob Title 

.ine Repairer (light, heat, & power) 821.361-026 

;uide for Occupational Exploration (GOE) Code 05.05.05; Electrical-Elect 
Jystems Installation and Repair 

lob Summary: 

'erforms all operations of work entailed in the transmission, distribu 
substation, and underground phases of installation, repair, replacements 
naintenance of the supply of electrical power from the power plant tc 
;onsumer. 



dork Performed: 

Irects steel towers, poles, and extensions, attaches cross-arms, insula 
jnd other equipment, and strings wire to transmit high voltage electric cu 
Prom generating system to substation and/or between substations. 

Climbs poles or rides in bucket attached to truck mounted boom to remove b 
}r defective wires, secures new wires to cross-arm insulators and splices 
to adjoining sections of line to complete circuit. Suspends insulated la 
jnd platforms from pole cross-arms and covers energized lines with rubber 
to facilitate safe handling of high-voltage lines without interrupting se 
jy power shutoff. Uses long insulated poles fitted with mechanical 1 
lydraulically operated grasping and crimping tools. 

irects steel columns, towers, trusses, and buses; assembles gears; ins 
switches; hooks up transformers, oils circuit breakers and controls. 
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